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1. Introduction 

Directed transport has received a remarkable attention for a number of years now, since 
it has been recognized as a crucial issue in a number of physical and biological contexts 
(see the review and references therein). A striking phenomenon in this context is 
ratchets behavior, where currents may flow in a counter intuitive direction. Parrondo 
games (see [2] and references therein) offer a remarkable and simple illustration of these 
subtle transport properties: a random combination of two losing games may result in 
a winning strategy. In this paper we present a deterministic analogue of Parrondo 
games, in the form of a (piecewise linear), periodic map on the real line, and study 
transport properties by means of periodic orbit expansions in this simple setting 
they allow to perform analytic evaluations of the relevant quantities, while providing a 
highly effective perturbative technique to get accurate estimates in more general cases 
(for instance by considering nonlinear mappings). The paper is organized as follows: in 
section 2 we construct a deterministic realization of Parrondo games in the form of a 
one-dimensional mapping on the real line, in section 3 we briefly review how to study 
transport properties of deterministic systems by periodic orbits expansions, in section 4 
we apply such a theory to Parrondo mappings and discuss some features of our findings, 
and in section 5 we give our conclusions, and possible future developments of the present 
work. 

2. One-dimensional Parrondo mappings 

Let us briefly recall the simplest implementation of Parrondo games: we start from two 
simple games A and B: A is a simple coin tossing game with winning probability p 
and losing probability 1 — p: each time the game is played the player toss the coin: if 
he/she wins then the capital (an integer value, which we denote by X) is increased by 
one unit, otherwise it is decreased by the same amount. Game B is a little bit more 
complicated, as it requires two "coins" , selected upon inspection of the present value of 
the capital: if X = mo d m winning/losing probability is p 1 /l — p 1 , while in the opposite 
case (X ^ Q mod m) the winning/losing probability is p 2 /l — p 2 : M is a fixed integer. 
Now suppose that at any integer time step n (starting from zero) a game is played: 
X(n) with represent the instantaneous value of the capital. It turns out that fine tuning 
of the parameters leads to a paradoxical behavior: namely take M = 3, p — 1/2 — e, 
pi = 1/10 — e, P2 = 3/4 — e, for a sufficiently small value of e: both games are in this case 
slightly unfair: if the player keeps on playing A or B the capital will drop down linearly, 
while playing A or B in random order (for instance with probability 1/2) results in a 
winning strategy, where on the average the capital increases linearly with time! The 
paradox can be explained by a Markov chain analysis jl]. 

We now map the problem to a dynamical setting: that is we want to introduce a 
map Fp on the real line such that X(n + 1) = Fp(X(n)) where "transition probabilities" 
are a reflection of the game rules. Let's start from game A: the dynamical realization 
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is easily accomplished once we define Fp on the unit interval as follows: 

and then extend Q on the real line by translation symmetry 
Fpa(x + n) — Fp(x) + n n e Z 



(1) 



(2) 



(see Fig.([T}). The left branches of the map correspond to a winning event (capital is 




Figure 1. The map corresponding to game A 

increased by one unit, strictly speaking capital corresponds to the integer part of the 
dynamical variable here) while right branches account for losing events. In the theory 
we will employ later on together with the map on the real line we also need to consider 
a corresponding torus map Fp(i?) on the circle, that is simply defined as (see Fig. @) 

Fpa(#) = Fp(#)modl (3) 

The construction of a dynamical mapping corresponding to successive playing at B 
game is slightly more complicated, as the natural unit is not a single cell, but a group 
of three cells, due to the mod 3 condition: once we take it into account we may define 
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Figure 2. The torus map corresponding to game A 



in this case 
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Fig. © and (J3| show the corresponding map on the real line and on the (mod 3 torus), 
respectively. Now we are interested in a random combination of the two games: we 
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Figure 3. The map corresponding to game B 



call 7 the probability that at each step game A is played (1 — 7 will correspondingly be 
the probability of playing game £>): though a treatment involving composition of the 
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individual games' transfer operators is possible jH] , the simplest way of constructing the 
relevant dynamical map is to consider combined rates of winning and losing, and then 
designing the corresponding map. We define 

qi = JP + (1 - j)pi (5) 

and 

q2 = 1P+ (1 -J)P2 (6) 

these are the rates of winning if the capital is/is not equal to unity (mod3): the 
corresponding dynamical map is then very similar to fll| and precisely 
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The (torus) map is shown in Fig. (j3J): the labels r] G {1, 2, 3, 4, 5, 6} indicated on 
top of the figure are symbols defining a partition of the unit interval according to the 
support of the different branches of the map (cfr (J7J)), which we label by £ v . It is 
important to remark that in each subinterval rj both the slope of the map and the 
capital gain a v are constant: in particular a\ = cr^ = = +1 (winning intervals) and 
o"2 = 04 = 06 = — 1 (losing intervals). The slopes (which account for orbit instability) 
of the different branches are 
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The asymptotic properties of the combined game in this dynamical context correspond to 
transport features: we are particularly interested in evaluating the net directed velocity 
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Figure 5. The torus map corresponding to the random composition of games A and 
B 

v 

E x (n) = (X n -X ) = vn (9) 

and the diffusion coefficient D 

E 2 (n) = ((X n - X ) 2 ) - v 2 n 2 = 2D ■ n (10) 

where (. . .)o denotes an average over a set of initial conditions (for instance uniform 
distribution on the cell at the origin. 

3. Periodic orbit theory 

A suitable technique to compute exponents like v and D is via cycle expansions 
it automatically encompasses universality features, being invariant under topological 
conjugacies and, while allowing to get analytic results in the present context, it may be 
applied -as a genuine perturbative scheme- to possible generalizations (for instance if we 
consider maps where piecewise linearity is lost). Such a technique has been applied to 
other systems exhibiting chaotic transport [7], and also generalized to yield anomalous 
moments' exponents when intermittency appears jS] . We very briefly recall how v and D 
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are computed: a pedagogical introduction is contained in jHj. The asymptotic behavior 
of moments is determined through the generating function 

G n (j3) = (e« M ")> (11) 

as 

(12) 



QQ 

((x n -x y)= [--G n (p) 



dpi 



In this way one has to characterize the asymptotic behavior of the generating function: 
as in statistical mechanics of lattice systems a (generalized) transfer operator Cp may 
be introduced, such that 



G n ((3) = j dx[C n pPin \(x) (13) 

where p in is the density of initial conditions: thus the leading eigenvalue X{0) of the 
transfer operator dominates the asymptotic behavior of the generating function: 

G n (/3) ~ X(f3) n (14) 
while the expression for the transfer operator is as follows: 

[C P (f>\{x) = [dy S F >-to-v)5(Fp(y) - x)<f>{y) (15) 



A convenient way to compute the leading eigenvalue of Cp is provided by the dynamical 
zeta function [3J El which is expressed as an infinite product over prime periodic orbits 
of the torus map F: 

c ( o)V-) = n v-^at) ^ 

M V 1 pl J 

each orbit carries a weight determined by prime period n p , instability A p = 
Yli=o F'p{Fp{ x p)) an d ^ ne capital gain a p , that is the integer factor that gives the 
capital variation per cycle once the orbit is unfolded on the real line: if the orbit has 
symbol sequence ei, ... e np according to the partition defined earlier, then 



p 



k=i 

The way dynamical zeta functions enter the game is that their smallest zero coincides 
with the inverse of the leading eigenvalue of the transfer operator [3] : though this might 
look as a cumbersome way to attack the problem of averages computations, it turns out 
that if the symbolic dynamics of the system is under control (as in the present example, 
as we will show later) dynamical zeta functions may provide exact results (as in the 
Parrondo case), or, in more general examples, they yield a scheme to compute averages 
in a rapidly converging perturbative scheme jHUHI- We call z(/3) the smallest zero of the 
dynamical zeta function: by expanding f)l 1|14|) around (3 = we get 

(e /3( Mo)) ^ (1 + ^ (Xn _ Xq) + ^-(X n - X ) 2 + ...) (18) 
I 

\{(3) n ~ 1 + pn\'(0) + y [n(n - l)A'(O) 2 + nA"(0)] + . . . . 
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where we have taken into account that A(0) = z(0) _1 = 1, as the generalized 
transfer operator for (3 = coincides with the Perron- Frobenius operator whose leading 
eigenvalue (corresponding to the invariant measure) is A = 1. This easily yields v and D 
in terms of zeta functions 7j (notice that all cases dealt with in former papers however 
consider systems where symmetry yields v = 0) 

d(X n — X ) 



A'(0) 



dn 

For the diffusion constant we get 

D = i (A"(0) - A'(0) 2 ) . 
where the first derivative is given by (fK?|) . while 
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4. Parrondo transport from zeta functions 



In order to use formulas like ()19|21|) for the deterministic version of Parrondo games we 
have to provide an expression for the zeta function. This is done once we set up the 
symbolic rules for dynamics: by considering the torus map Fpa*b ( see fig- ©) the only 
allowed symbolic transitions are the following 
...13 14 25 26... 

...35 36 41 42... (22) 

...51 52 63 64... 

thus admissible symbolic sequences are generated by the Markov graph of fig. (0) As the 
weights we attach to cycles depend only on how many times different symbols appear 
in the cycle code, our problem is essentially topological and the zeta functions is a 
polynomial, which we can easily write down once we have the full list of non-intersecting 
loops of the Markov graph of fig. (jOJ). These are 

T4 25 36 135 264 1364 1425 2635 135264 136425 142635 (23) 

Then [HI E] 



-1 

(0)P 



E£<- 

fc=0 7T 



■l) k t ■■■t 



(24) 



where all possible combinations tt of non intersecting loops Pi - ■ - Pk are considered, / is 
the maximum number of non intersecting loops that we may put on the graph and 

t P = — r— (25) 
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Figure 6. The Markov graph generating symbol sequences for the map Fpa*b 



Once we take into account cancellations (for instance the cycle 142635 is completely 
shadowed by the product of 14 and 2635 cycles) the generalized zeta function is written 

as 

-1 / \ 1 2 I c , e , e \ 3 ' e 



= 1 - z 2 ( qi (l - q 2 ) + g 2 (l - 9l ) + g 2 (l - g 2 )) - 

+ ^ 3 (e 3 %g 2 2 + e-^(l- gi )(l-^) 2 ) 

where we have taken into account how instabilities (JBJ) are expressed in terms of 
transition probabilities (|5|6jl . Now we take the original Parrondo values 

113 

p = e Pi = e p 2 = e (27) 

^ 2 ^ 10 F 4 V 7 

and take 7 = 1/2: once we insert (j26|) into (|T9|) we may verify Parrondo paradox, namely 

how unfair games (for small positive e) lead to capital gain: see fig. (J7J), and in the same 

way we may look at the behavior of the diffusion coefficient (see fig. (jH))) In the same 

fashion we may check how transport exponents depend on the parameter 7 once the 

bias e is fixed (see the current behavior in fig. 0) 

It turns out that by using the explicit form of the zeta function we can actually 

derive analytical expressions for such quantities: for instance the current v as a function 

of e for 7 = 1/2 reads (in agreement with 0]) 

. 6 (3 - 229e + 16e 2 - 320e 3 ) 

Vl,2{t) = 709 - 32e + 960e> (28) 

while, more generally we can express the current v as a function of both e and 7 as 

= 6 (-806 3 + 8(1 - 7 )e 2 - (11(2 - 7)7 + 49)e + 2(1 - 7 )(2 - 7)7) 
Vn/[e) " 240e 2 - 16(1- 7)6 + 11(2-7)7 + 169 1 ' 

Analytic expression may be obtained also for the diffusion constant D, for instance 

D 1/2 (e) = -(9(4e(e(64e(e(64e(5e(320e(15e - 2) + 9243) - 4487) + 1458885) + 

-69761) - 6333811) + 1191650) - 34590345))/(2(32e(30e - 1) + 709) 3 ) (30) 
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Figure 7. The current v as a function of "unfairness" parameter e for small positive 
e ( 7 = 1/2) 



0.4368 



D 




Figure 8. The diffusion coefficient D as a function of "unfairness" parameter e 
(7 = 1/2) 

5. Conclusions 

We have constructed a one-dimensional mapping providing a deterministic version of 
Parrondo games: once the symbolic dynamics is coded, periodic orbit theory offers a 
way to get analytic estimates of all the relevant transport exponents. While in this 
paradigmatic example results may be obtained via probabilistic techniques jH H2j we 
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Figure 9. The current v as a function of 7 for e = (full line), e = 0.005 (dashed 
line) and e = 0.01 (dotted line). Maxima are attained at 7 = 0.414588, 7 = 0.408161 
and 7 = 0.401643, respectively. 



remark two things: once the structure of the relevant zeta function is explicitly derived 
all statistical averages may be computed in a similar way in the present framework: 
moreover our work may be considered as a first step towards the periodic orbit analysis of 
"nonlinear" Parrondo games, where the map ceases to be piecewise linear: in particular 
we plan to investigate sticking effects in this context, by considering intermittent 
Parrondo maps. 
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